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Polya processes are natural generalization of Polya-Eggcnberger urn mod- 
els. This article presents a new approach of their asymptotic behaviour via 
moments, based on the spectral decomposition of a suitable finite difference 
transition operator on polynomial functions. Especially, it provides new 
results for large processes (a Polya process is called small when 1 is simple 
eigenvalue of its replacement matrix and when any other eigenvalue has a 
real part < 1/2; otherwise, it is called large). 



Les processus de Polya sont une generalisation naturelle des modeles d'urnes 
de Polya-Eggenberger. Cet article presente une nouvelle approche de leur 
comportement asymptotique via les moments, basee sur la decomposition 
spectrale d'un operateur aux differences finies sur des espaces de polynomes. 
En particulier, elle fournit de nouveaux resultats sur les grands processus 
(un processus de Polya est dit petit lorsque 1 est valeur propre simple de 
sa matrice de remplacement et lorsque toutes les autres valeurs propres ont 
une partie reelle < 1/2 ; sinon, on dit qu'il est grand). 
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1 Introduction 

Take an urn (with infinite capacity) containing first finitely many balls of s different 
colours named 1, .... s. This initial composition of the urn can be described by 
an s-dimensional vector Ui, the fc-th coordinate of U\ being the number of balls 
of colour k at time 1. Proceed then to successive draws of one ball at random in 
the urn, any ball being at any time equally likely drawn. After each draw, inspect 
the colour of the ball, put it back into the urn and add new balls following at any 
time the same rule. This rule, summed up by the so-called replacement matrix 

R = {n,j)i<i,j< s e M S (Z) 

consists in adding (algebraically), for any j G {1, . . . , s}, rij balls of colour j when 
a ball of colour i has been drawn. In particular, a negative entry of R corresponds 
to subtraction of balls from the urn, when it is possible. The urn process is the 
sequence {U n ) n >i of random vectors with nonnegative integer coordinates, the k- 
th coordinate of U n being the number of balls of colour k at time n, i.e. after the 
(n — l)-st draw. 

Such urn models seem to appear for the first time in [7]. In 1930, in its original 
article Sur quelques points de la theorie des probabilites ([18j). G. Polya makes a 
complete study of the two-colour urn process having a replacement matrix of the 
form S.ld.2, S G Z>i. 

We will only consider balanced urns. This means that all rows of R have a 
constant entries' sum, say S. Under this assumption, the number of added balls 
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is S at any time, so that the total number of balls at time n is non random. 
Furthermore, we will only consider replacement matrices having nonnegative off- 
diagonal entries. Any diagonal entries may be negative but subtraction of balls 
of a given colour may become impossible. In order to avoid this extinction, one 
classically adds an arithmetical assumption to the column of any negative diagonal 
entry in R (see Definition 11.11 and related comments). An urn process submitted 
to all these hypotheses will be called Polya-Eggenberger, in reference to the 
work of these authors. 

A Polya-Eggenberger urn process can be viewed as a Markovian random walk 
in the first quadrant of R s with finitely many possible increments (the rows of 
R) , the conditional transition probabilities between times n and n + 1 being linear 
functions of the coordinates of the vector at time n. This point of view leads to the 
following natural generalization: we will name Pdlya process such a random walk in 
K s with normalized balance (S = 1), even if it does not come from an urn process, 
i.e. even if U\ and R have non- integer values. Note that a Polya process as it is 
defined just below looks very much like a Polya-Eggenberger urn process, with the 
only difference that instead of counting a number of balls, we deal with a positive 
real quantity lk(X n ) associated with each colour k (corresponding to the "number 
of balls" of this colour at time n), which gives the propensity to pick this colour 
at the next step. In this setting, Wk is the vector in M s defined by the fact that, 
when colour k has been drawn, then for all j G {1, . . . , s}, one adds lj(wk) "balls" 
of colour j to the urn. Polya processes generalize Polya-Eggenberger urns only 
because this propensity may be real- valued (see comments after Definition II. ip . 

Definition 1.1 Let V be a real vector space of finite dimension s > 1. Let X\, 
w\, . . . , w s be vectors ofV and (lk)i<k<s be a basis of linear forms on V satisfying 
the following assumptions: 

i- (initialization hypothesis) 

Xi^O and Vfc G {l,...,s}, l k (Xi) > 0; (1) 

ii- (balance hypothesis) for all k G {1, . . . , s}, 

s 

5>H0 = i; (2) 

Hi- (sufficient conditions of tenabilit^) for all fc, k' G {1, . . . , s}, 

k^k' => lk(wk') > 0, (0a) 



h(w k ) > or l k (Xi)Z + h(wj)Z = l k (w k )Z. (06) 



(3) 



1 Some authors prefer the vocable viability instead of tenability. This last word has been 
chosen in reference to recent literature on the subject. 
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The (discrete and finite dimensional) Polya process associated with these data is 
the V-valued random walk (X n ) n< z% >1 with increments in the finite set {w\, . . . , w s }, 
defined by X\ and the induction: for every n > 1 and k S {1, . . . , s}, 

Prob (X n+1 = X n + w k \X n ) = ^™ (4) 

where r% is the positive real number defined by 

s 

r 1 = J2h(Xi). (5) 

fe=i 

The process is defined on the space of all trajectories of X\ + ^2 1<k<s ^>oWk 
endowed with the natural filtration (^ r ra ) n >o where T n is the er-field generated by 
X\ , . . . , X n . It is Markoviar0 and the transition conditional probabilities between 
times n and n+1 depend linearly on the state at time n, as stated in equations (U]). 
Conditions {1} and ([2]) are necessary and sufficient for the random vector X2 to be 
well defined by Relation ((4]); a readily induction shows the deterministic relation 

s 

Vn>l, ^I fc (X n ) = n + n-l. (6) 
fc=i 

Condition ([3]) suffices to guarantee that the process is well defined, i.e. that the 
numbers lk(X n ) do not become negative so that the process does not extinguish 
as can be checked by an elementary induction. The arithmetical assumption ([21 6), 
which has become classical (compare with [TT], [Tl], for urns) is equivalent to 
the following one: lk(wk) is nonnegativc, or it divides lk{X{) and all the lk(wj) 
as real numbers. Actually, if conditioned on non extinction, all the results about 
Polya processes in this article remain valid when conditions ([3]) are removed from 
the definition. 

Polya processes are natural generalizations of Polya-Eggcnberger urns in the 
following sense (see [2], [TT], [S], [5U] for base references on Polya-Eggcnberger 
urns). Take a Polya-Eggenberger s-colour urn process having replacement matrix 
R and vector (7i as initial composition; let S be the common sum of i?'s rows, 
assumed to be nonzero. The data consisting in taking the rows of jgR as vectors 
Wf-'s, the coordinate forms as forms i^'s and X% = -kill as initial vector define a 
Polya process {X n ) n on W , the random vector X n being 1/S times the 1 x s matrix 
U n whose entries are the numbers of balls of different colours after n — 1 draws. 
We will name this process standardized urn process. Conversely, if one considers 
the forms Ik of a Polya process as being the coordinate forms of V (choice of a 
basis of V), the matrix whose rows are the coordinates of the Wk's satisfies all 

2 The time-homogeneity of the process is more explicit when one reads condition with 
denominator y\ lj,(X n ) instead of n + ti — 1 (use Relation ((SJl). 
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hypotheses of a Polya-Eggenberger urn's replacement matrix with balance S = 1, 
except that its entries are not integers but real numbers. This matrix will still 
be called replacement matrix of the process. Note that the balance property is 
expressed in Relation (J5J). The definition of Polya processes is readily stable after 
linear change of coordinates, when urn processes do not have this property. 

The present text deals with Polya processes, so that all its results are valid for 
Polya-Eggenberger urn processes. Such a process being given, different natural 
questions arise: what is the distribution of the vector at any time n? Can the 
random vector be renormalizcd to get convergence? What kind (and speed) of 
convergence is obtained? What is the asymptotic distribution of the process? 

Since the work of Polya and Eggenberger, many authors have considered such 
models, sometimes with more general hypotheses, often with restrictive assump- 
tions. Direct combinatoric attacks in some particular cases were first intended 
(|18j. [7], [TU] for example). In the last years, they have been considerably refined 
by analytic considerations on generating functions in low dimensions by much more 
general methods ([5], [2D])- A second approach was first introduced in [T] and de- 
veloped in [14j and |16j . viewing such urns as multitype branching processes. It 
consists in embedding the process in continuous time, using martingale arguments 
and coming back to discrete time. This method provides convergence results. One 
can find in [9], [20] and [14] good surveys and references on the subject. 

A Polya process will be called small when 1 is simple eigenvalue of the re- 
placement matrix R and when every other eigenvalue of R has a real part < 1/2. 
Otherwise, it will be said large. 

Under some assumptions of irreducibility on R, it is well known that if [X n ) n 
is a small Polya process, a normalization (X n — nv\)/yn log" n converges in law 
to a centered Gaussian vector, v\ being a deterministic vector and v a nonncgative 
integer that depends only on the conjugacy class of R - see Q3] for a complete state- 
ment of that fact. In the case of reducible small processes, convergence in law after 
normalization has been shown for several families of processes in low dimensions; 
this concerns for instance urns with triangular replacement matrix ([5], |16j . |20j . 
Example 2- in Subsection 17. 2[) . Found limit laws in these studies are most often 
non normal. 

In the case of large Polya processes, a suitable normalization of the random 
vector X n leads to an almost sure asymptotics, as shown in Theorems 13.51 and 13. 6i 
main results of the paper. These results do not require any irreducibility assump- 
tion. This asymptotics is described by finitely-many random variables Wk that 
appear as limits of martingales. Joint moments of the Wk are computed in terms 
of so-called reduced polynomials ((9a)ae(z> ) s that will be defined later and initial 
conditions of the process. We give hereunder a simplified version of the result: 
suppose that the replacement matrix R has 1 and A2 as simple eigenvalues and 
that any other eigenvalue is the conjugate A2 or has a real part < Re(\%). Such a 
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process will be called generic @. 

Asymptotics of generic large Polya processes If (X n ) n is a generic large 
Polya process, there exist some complex-valued random variable W and non ran- 
dom complex vectors v\ and v 2 such that 



X n = nvi + 3? {n X2 Wv 2 ) + o (n K(A2) ) 



the small o being almost sure and in any L p , p > 1. Furthermore, any joint 
moment of the variables W and its complex conjugate W is given by the formula 

E{W?Wi) = F(ti) _ Q ( o, p , g , 0! ...)(*i) 

r(n +pA 2 + q\2) 

where T is Euler's function. 

The positive number n, defined by l[5"]). depends on initial condition X\. Vectors v\ 
and t>2 are here eigenvectors of the replacement matrix respectively associated with 
the eigenvalues 1 and A 2 . In particular, the second order term is oscillating when 
A 2 is non real, giving a complete answer to the already observed non convergence 
of any non trivial normalization (X n — EX n )/n z , zgC (see [S] and related papers 
for example). 

The method used here to establish the general asymptotics of large Polya 
processes also leads to results on distributions at finite time (exact expressions 
for moments for example) but we do not focus on this point of view. It relies on 
asymptotic estimates of suitable moments of X n . Hence, the first step is to express, 
for general functions /, the expectation Ef(X n ) in terms of initial condition Xi 
and of iterations of a finite difference operator $, namely, by Proposition 14. II 

Ef(X n )= lTun ($)(f)(X 1 ) 

where 7 Tl ,n is the polynomial defined by 7 T1 ,i = 1 and, for any n > 2, 

t 



$ is the transition operator associated with the process, defined on the space of 
all functions / : V — > K (or more generally on the space of all functions / : V — > W 
where W is any real vector space) by: Vu £ V, 



*(/)(«)= E l ^ 



Kk<s 



f{v + w k ) - f(v) 



(8) 



3 Note that such a process is generic in the sense that almost all (in the strong sense of 
algebraic geometry) replacement matrices of Polya processes satisfy this assumption. 
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The second step is to study this linear operator $ on its restriction to the space of 
linear forms on V, which leads to set a corresponding Jordan basis (uk)i<k<s of 
this space, with corresponding eigenvalues (\k)i<k<s (Definition 12.3ft . The third 
step consists in observing, as done in Proposition 13.11 that $ stabilizes, for any 
a 6 (Z>o) s , the finite dimensional polynomial subspace S a = Span{u /3 , ft < a} 
where, for all ft = (fti, . . . , ft s ) £ (Z> ) s , u 13 = ni<fe< s u k h ana ^ — 1S tne degree- 
antialphabetical order on s-uplcs of integers, defined below by (JTSJ). Therefore, it 
is subsequently possible to decompose any u-monomial u Q , a 6 (Z>o) s as a sum of 
functions in the characteristic subspaceqj ker($ — z)°° = U n >o ker($ — z) n , z £ C. 

If one denotes A = (Ai, . . . , A s ) and {a, A) = J2i<k<s a k^k for any a £ (Z> ) s , 
it turns out that the eigenvalues of the restriction of $ to stable finite dimensional 
polynomial spaces are precisely the (a, A), as justified in Section[3J The projection 
of any u Q on ker($ - (a, A))°° parallel to Z _^ Q X ) ker(<!> - z)°° will be denoted 
by Q a and named reduced polynomial of <& of rank a. The reduced polynomials 
of rank < a constitute a basis of S a and any u" can be written 

u a = Q a + 1a,pQp (9) 

/3<a, < / 3 : A)#( Q ,A) 

as proved in Proposition ^. 81 

This leads to an asymptotic estimate of the moments Eu a (X n ) fTheorem l3.4p 
since, for any z € C and any / S ker($ — z)°°, there exists an integer v > such 
that 

Ef(X n ) ~ n-log-n r(n) (1Q) 

n— >+oo v\ 1 \T\ + Z) 

as it is proven in Corollary |4.2l The asymptotic estimate in Theorem l3.4l is based on 
the determination of the indices ft in expansion ([9]) that contribute to the leading 
term of E u a (X n ); this is the object of the whole Subsections 14.41 and 14.51 To this 
end. Theorem 14.201 enables to refine Relation ©: it implies that a coefficient q a ,p 
does not vanish only if ft belongs to a convex polyhedron (A a — S) n (M>o) s of 
R s , where A a is a the set of nonnegative integer points of a certain rational cone 
with vertex a that depends on the Polya process and E a universal rational cone 
(universal means here that E is the same one for any Polya process). Definitions 
of E and A a are respectively given by (|35|) and (|39|) . Formula (J9j) can thus be 
refined into 

u Q = Q Q + ( n ) 

which is the same as Relation (|4"4"]) . 

We will say that a = (cti, . . . ,a s ) £ (Z>o) s is a power of large projections 
whenever ak = for all indices k such that 3?(Afe) < 1/2; similarly, a will be called 

4 Whcn the context is unambiguous, if 2 is a complex number, z will also denote zl where I 
is the identity endomorphism. 
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power of small "projections whenever ak = for all indices k such that Si(Afc) > 1/2. 
Now, if a is a power of large projections, Propositions 14. 151 1- and 14.191 imply that 
3f(/3, A) < U(a,X) whenever (3 £ A a - E, (/?, A) 7^ (a, A). Therefore, thanks 
to Relation (jTOJ) , the leading term of Eu a (X n ) in Formula (jTTJ) will come from 
EQ a (X n ) only, with an order of magnitude of the form n^ Q,A ^ log 1 ' n, the number 
A) being > |a|/2. Similarly, Propositions 14.151 2- implies that, if a is a power 
of small projections, this order of magnitude never exceeds n} a ^ 2 log v n for some 
nonnegative integer v. A precise statement of these moments' asymptotics is given 
in Theorem l3.41 Note that the intervention of E can be bypassed by a self-sufficient 
argument that have been suggested by the anonymous referee (see Remark [53]) . 

Section [5] is devoted to Jordan decomposition of $'s restriction to linear forms 
and related definitions and notations. The main results of the paper are introduced 
and completely stated in Section [5] while the action of transition operator <E> on 
polynomials is studied in Section 2] This is done in three steps: first, the stability 
of the filtration (S a ) a of subspaces is established as well as its consequences on 
reduced polynomials; cone E and polyhedra A a are then introduced in the space 
(R>o) s of exponents; afterwards, consequences of these geometrical considerations 
are drawn to refine $'s action. Main Theorems 13.41 13.51 and 13.61 are proved in 
Sections [5] and [5J At last, Section [7] contains diverse remarks and examples. 

Acknowledgements 

The author is very grateful to the anonymous referee whose careful reading of 
a preprint version of this paper and helpful comments on it greatly improved its 
quality. 

2 Preliminaries, notations and definitions 

Definition of Polya processes in a real vector space V of finite dimension s > 
1 was given in Definition 11.11 We associate with any process its replacement 
endomorphism that will be denoted by A in reference to literature on the subject 
(PQ, [T3] for example). Let Vc = V ®r C be the complexified space of V. 

Definition 2.1 If (X n ) n is a Polya process, its replacement endomorphism 

is, with notations of Definition [7T71 the endomorphism A = ^i<fe<s Ik ® w k £ 
V* (g) V ~ End(V), defined as 



for every v in V . 

Note that the transpose of A is the restriction of the transition operator $ to linear 
forms on V. When the process is a Polya-Eggenberger urn process, the matrix of 




Kk<s 
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A in the dual basis of {lk)k is the transpose of the normalized urn's replacement 
matrix j^R (notations of Section [T]). 

With this definition, the expectation of X n+ i conditionally to X n is readily 
expressed as (I + n+ f i _ 1 )X n , so that the expectation of X n equals 

EX n = lTun {A){X 1 ) 

(straightforward induction). 

One of the first tools used to describe the asymptotics of a Polya process 
is the reduction of its replacement endomorphism A (or of its transpose on the 
dual vector space of V). Because of condition ([2|), the linear form u\ = Yfk=i ^ k 
satisfies u\ o A = Ui, which shows that 1 is always eigenvalue of A. The whole 
assumptions {J),© and allows us to say more on A's spectral decomposition. 
Even if these properties can be proved using Perron-Frobcnius theory, we give a 
proof's hint of Proposition [272] 

Proposition 2.2 Any complex eigenvalue X of A equals 1 or satisfies KA < 1. 
Moreover, dimker(v4 — 1) equals the multiplicity of 1 as eigenvalue of A. 

Proof. Replace A by its matrix in the dual basis of (h)k- Suppose first that all 
entries of A are nonnegativc. The space of all s x s matrices having nonncgative 
entries and columns with entries' sum 1 is bounded (for the norms' topology) and 
stable for multiplication. This forces the sequence (A n ) n >o to be bounded, which 
implies both results (for the second one, consider Jordan's decomposition of A and 
note that the positive powers of I + N constitute an unbounded sequence if TV is 
a nilpotent nonzero matrix). If A has at least one negative diagonal entry, apply 
the results to (A + a)/(l + a) for any positive a such that A + a has nonnegative 
entries. ■ 

In the whole paper, a Polya process with replacement endomorphism A being 
given, we will denote by 02 the real number < 1 defined by 

{1 if 1 is multiple eigenvalue of A; 
(12) 
max{5RA, A G Sp(^4), A ^ 1} otherwise, 

where Sp(A) is the set of eigenvalues of A. 

2.1 Jordan basis of linear forms of the process 

The present subsection is devoted to notations and vocabulary related to spectral 
properties of the replacement endomorphism A. 
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Definition 2.3 If (X n ) n is a Polya process of dimension s, a basis (v-k)i<k<s of 
linear forms on Vc is called a Jordan basis of linear forms of the process or 
shortlier a Jordan basis when 

1 ~ u i = Ei<fc<Jfc/ 

2- Uk o A = AfeMfc + £feWfe_i for all k > 2, where the A& are complex numbers 
(necessarily eigenvalues of A) and where the are numbers in {0, 1} that satisfy 
Afc ^ A fc -i ==> e k = 0. 

In other words, the matrix of the transposed endomorphism A in a Jordan basis of 
linear forms has a block-diagonal form Diag (1, J Pl (Afo), • • ■ , J Pt (Ajt t )) where J p (z) 
denotes the p-dimensional square matrix 

( z 1 \ 

J p (z) = 

1 

V * ) 

A (real or complex) linear form u k will be called eigenform of the process when 
Uk o A = AfcUfc, i.e. when e k = 0. An eigenform of the process is an eigenvector of 
*A; some authors call these linear forms left eigenvectors of A, refering to matrix 
operations. 

Definition 2.4 A Jordan basis of linear forms being chosen with notations as 
above, a subset J C {1, . . . , s} is called a monogenic block of indices when J 
has the form J = {m, m + 1, . . . , m + r} (r > 0, m > 1, m + r < s) with e m = 0, 
Ek = 1 for every k G {m + 1, . . . , m + r} and J is maximal for this property. Any 
monogenic block of indices J is associated with a unique eigenvalue of A that will 
be denoted by A (J). 

In other words, J is monogenic when the subspace Spanjuj, j £ J} is A-stable 
and when the matrix of the endomorphism of Spanjitj, j G J} induced by *A in 
the Jordan basis is one of the Jordan blocks mentioned above with number A( J) 
on its diagonal. The adjective monogenic has been chosen because this means that 
the subspace Span{u_,, j G J} = C['A].u m + r is a monogenic sub-C[f] -module of 
the dual space for the usual C[£]-module structure induced by *A. 

Definition 2.5 A monogenic block of indices J is called a principal block when 
5RA(J) = 02 and J has maximal size among the monogenic blocks J' such that 
5RA(J') = (72 (see \12\) for 0-2 's definition). 

A Jordan basis (uk)i<k<s of linear forms of the process being chosen, 

(vk)i<k<s (13) 
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will denote its dual basis, made of the vectors of Vc that satisfy Uk(in) = 5k j 
(Kronecker notation) for any k and I, and 

A = (A ll ...,A s ) (14) 

the s-uple of eigenvalues (distinct or not) respectively associated with ui,...,u s 
(or vi, . . . ,v s ). In particular, Ai = 1 for any Jordan basis of linear forms. The 
eigenvalues Ai,...,A s of A are called roots of the process. For any k, we 
also denote by iru the projection on the line <Cvk relative to the decomposition 
Vc = ©k/< s Cvi; these projections satisfy 

Id = ^2 and irk — Ufc. Ufc. (15) 

l<fc<s 

Note that the tt^ commute with each other (w^i = 5k^k) but do not commute 
with A. Nevertheless, A commutes with X^eJ "j' * ne sum being extended to any 
monogenic block of indices J (these sums are polynomials in A) . This fact will be 
used in the proofs of Theorems 13.51 and 13.61 The lines spanned by the vectors Vk 
can be seen as principal directions of the process, the word principal being here 
used in physicists' sense. 

2.2 Semisimplicity, large and small projections 

For every Jordan basis (ufc)i<fc< s of linear forms, and for every a = (ctk)i<k<s S 
Z s , we adopt the notations 

|a| = a.k (total degree) 

l<k<s 

(16) 

(a, A) = 2J a k^k 

l<k<s 

and, when all the ctk are nonnegative integers 

u*= n 

l<fc<s 

u" being a homogeneous polynomial function of degree \ce\. 

Given a Jordan basis (v.k)i<k<s of linear forms of the process, we adopt the 
following definitions. 

Definition 2.6 A Polya process is called semisimple when its replacement en- 
domorphism A is semisimple, i.e. when A admits a basis of eigenvectors in Vc 
(this means that all the Uk are real or complex eigenforms of A). The process is 
called principally semisimple when all principal blocks have size one (for any 
choice of a Jordan basis). 
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The four following assertions are readily equivalent: 

i) the process is principally semisimple; 

ii) for any k G {1, .. . , s}, (JftXk = o~2 ==> «fc is eigenform); 

hi) the induced endomorphism sj}A fc =er 2 } n k)A is diagonalizable over C; 

iv) if r > 1 and if {A&, fc > r + 1} are the roots of the process having a 
real part < the matrix of l A in the Jordan basis has a block-diagonal form 
Diag (1, A 2 , . . . , A r , J P1 (A fcl ), . . . , J Pt (A fef )). 

Note that Proposition 12. 21 asserts that any Uk associated with root 1 is eigenform 
of A. 

Definition 2.7 A root of the process is called small when its real part is < 1/2; 
otherwise, its is said large. The process is called small when a 2 < 1/2. which 
means that 1 is simple root and all other roots are small; when the process is not 
small, it is said large. 

Definition 2.8 Let a = (ai, . . . , a s ) G (Z>o) s . 

1- a is called power of large projections when u Q is a product of linear forms 
associated with large roots, i.e. when for all k G {1, . . . , s}, (a,k ^ ==>■ SRA^ > 
1/2). 

2- a is called power of small projections when u Q is a product of linear forms 
associated with small roots, i.e. when for all k G {1, . . . , s}, (a^ ^ ==> SRA/c < 
1/2). 

3- a is called semisimple power when u Q is a product of eigenforms, i. e. when 
for all k G {1, . . . , s}, (a^ 7^ => Uk is eigenform of the process) . 

4~ a is called monogenic power when its support in contained in a monogenic 
block of indices. 

In the whole text, the canonical basis of Z s (or of M s ) will be denoted by 

(4)i<fe< s (17) 

and the symbol 

a<(3 (18) 
on s-uples of nonnegative integers will denote the degree-antialphabetical (to- 
tal) order, defined by a ~ (ax, . . . , a s ) < (3 = (J3x, ■ ■ ■ , As) when ^|a| < or 

^\ce\ = \f3\ and 3r G {1, . . . , s} such that a r < f3 r and at = fit for any t > r^j . For 

this order, 5i < 8 2 < ■ ■ ■ < 8 S < 26i < 5 X + 5 2 ■ ■ ■ . 

When a = (ax, . . . , a s ) is a s-uple of reals, the inequality 

a > 

will mean that all the numbers are > 0. 
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3 Main results 



As it was briefly explained in Section [T] the method used to study the asymptotics 
of a Polya process (X n ) n relies on estimates of its moments in a Jordan basis, 
namely Eu a (X n ), a £ (Z>o) s . To this end, as it is developed in Subsection [JTJ it 
is natural to consider the transition operator $ as it was defined by Equation ([5]). 
Proposition 13.1 l is the first result on the action of $ on polynomials. One can find 
a proof of it in Subsection 14.21 

Proposition 3.1 For any choice of a Jordan basis (iik)i<k<s of linear forms of 
a Polya process and for every a £ (Z>o) s , 

$(u Q ) - (a, A) u Q £ Spanju' 3 , (3 < a}. 

The complex numbers (a, A) were defined in (|16p . An immediate consequence of 
this proposition is the ^-stability of the finite-dimensional polynomial subspace 

S a = Span-fti", (3 < a} (19) 

for any a £ (Z>o) s . These subspaccs form an increasing sequence whose union is 
the space S(V) of all polynomial functions on V, so that Proposition 13. f I asserts 
that the eigenvalues of $ on S(V) are exactly all numbers (a, X), a £ (Z> ) s (in 
the (ordered) basis (u^)^< a of any S a , the matrix of $ is triangular). 

Notation: if ^ is an endomorphism of any vector space, we will denote by 
ker Vl/ 00 the characteristic space of ^ associated with zero, that is 

ker^°° = [j kerfP. (20) 

p>0 

We will use the notation $ to refer to <& itself as well as to the endomorphism 
induced by $ on S(V) or on some stable subspace. Decomposition of all S a as 
direct sums of characteristic subspaces of $ leads to the splitting 

^(y) = 0ker($- Z )° o . 

zeC 

As it was announced in Section [1] we can now properly define the reduced poly- 
nomials. 

Definition 3.2 For any choice of a Jordan basis (uk)i<k<s of linear forms of a 
Polya process and for any a £ (Z>o) s , the reduced polynomial of rank a is 

the projection of u Q on ker(<f> — (a, A))°° parallel to (J) z _^ a A ^ ker(<3> — z)°° . It will 
be denoted by Q a . 
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Properties of reduced polynomial will be further developed in Section |U In par- 
ticular, it will be explained how one can compute them inductively (see ([32])). 
They admit sometimes closed formulae (see ([55]). (T5] and ([55])). It follows from 
its definition that Q a belongs to ker((f> — (c^A)) 00 ; the number v a defined just 
below is its index of nilpotence in this characteristic space. In particular, v a = 
if, and only if Q a is eigenvector of $. Proposition [STU in Subcction 15.21 shows how 
one can easily compute this number for any power of large projections. 

Definition 3.3 For every a G (Z>o) s , the nonnegative integer v a is defined by 

v a = max{p > 0, (* - (a, X)) p (Q a ) + 0}. (21) 

These facts, definitions and notations being given, we claim the following three 
main results of the article. 

Theorem 3.4 (Joint moments of small or large projections) Let (uk)i<k<s 
be a Jordan basis of linear forms of a Polya process (X„) n . Let a £ (Z>o) s . 

1- If a is a power of small projections, then there exists some nonnegative 
integer v such that 

Eu a (X n ) e O (7il Q l/ 2 log^n) 

as n tends to infinity. 

2- If a is a power of large projections, then there exists a complex number c 
such that 

E u a (X n ) = cn< a,A > log"" n + o (n K < Q < A > log"" n) 

as n tends to infinity. 

3- If a is a semisimple power of large projections, then 

(X n ) = ( } + o / B<aiA) N 

r(ri + (a,A)) V J 

as n tends to infinity, where Q a is the reduced polynomial of rank a relative to the 
Jordan basis (uk)i<k<s- 

Constant c in Assertion 2- has an explicit form given in Rcmark l5.3l The proof of 
Theorem l3.4l can be found in Section[5j It is based on a careful study of coordinates 
of the u- monomials in the basis of reduced polynomials, which is developed in 
Subsections [O] and 14.51 

Although it is not formally necessary, we give two different statements on the 
asymptotics of large Polya processes, respectively when the process is principally 
semisimple or not. Their proofs can be found in Section [6] They are based 
on Theorem 13.41 and use martingale techniques (quadratic variation, Burkholder 
Inequality) . 
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Theorem 3.5 (Asymptotics of large and principally semisimple Polya 
processes) Suppose that a Polya process (X n ) n is large and principally semisim- 
ple. Fix a Jordan basis (uk)i<k<s °f linear forms such that uij. . . ,u r (2 < r < s) 
are all the eigenforms of the basis that are associated with rooto Ai = 1, A2, • ■ • , A r 
having a real part > 02 ■ 

Then, with notations A13\) and \1J$ of Section [H there exist unique ( complex- 
valued) random variables W2, • ■ ■ , W r such that 

X n = nvi+ " Afc WkVk + ) . ( 22 ) 

2<k<r 

the small o being almost sure and in L p for every p > 1. Furthermore, if one 
denotes by {Q a ) a £(z >0 ) s the reduced polynomials relative to the Jordan basis (uk)k> 
all joint moments of the random variables W% , . . . , W r exist and are given by: for 
all ct2, ■ ■ ■ , ct r e Z>o, 

where a = Y.2<k<r a ^k = (0,(22, ■ • • , a r , 0, . . . ). 

Theorem 3.6 (Asymptotics of large and principally nonsemisimple Polya 
processes) Suppose that the Polya process (X n ) n is large and principally non- 
semisimple. Fix a Jordan basis (uk)i<k<s of linear forms; let J2, ■ ■ ■ , J r be the 
principal blocks of indice^ and v + 1 the common size of the J^'s (v > 1). 

Then, with notations A13\) and \1J$ of Section [H there exist unique ( complex- 
valued) random variables W2, ■ ■ ■ , W r such that 

X n = nv 1 + ^\og l, n n KJk) W k v maxJk + o (n°* log" n) , (23) 

2<fc<r 

the small o being almost sure and in L p for every p > 1. Furthermore, if one 
denotes by {Qa) a e(i >0 ) s the reduced polynomials relative to the Jordan basis (uk)k, 
all joint moments of the random variables W2 , ■ ■ • , W r exist and are given by: for 
all a.2, ■ ■ ■ , ct r e Z>o, 

* ( n -r) - ^^.w 

where a = Yl,2<k<r "fc^mm j k ■ 

5 In short, if 1 is multiple root, Ai = ■ ■ ■ = A r = 1; otherwise, i < 5RA2 = • ■ • = 5RA r = <T2 < 1. 
See l|12ll , definition of 02. 

6 In other words, if J is any Jordan block of A in the u^s basis, J is 1 or one of the J^'s, or 
the size of J is < v, or the root of J has a real part < 02- See Definition f23] (principal blocks). 
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4 Transition operator 



Let (X n ) n be a Polya process given by its increment vectors (wk)i<k<s and its 
basis of linear forms (7fc)i<fc< s submitted to hypotheses of Definition 11.11 We 
recall here the definition of its associated transition operator $ as it was given in 
Section [1] if / : V — ► W is any W- valued function where W is any real vector 
space, Vv € V, 



E 

Kk<s 



h(v) 



f(v + w k ) - f(v) 



4.1 Transition operator $ and computation of moments 



Proposition [44] expresses the expectation of any f(X n ) in terms of /, of iterations 
of the transition operator $ and of X\, initial value of the process. Polynomials 
7ri,n with rational coefficients and one variable were defined by Equation 0. 

Proposition 4.1 If f : V — > W is any measurable function taking values in some 
real (or complex) vector space W , then for all n > 1, 

Ef(X n ) = lTl<n (<t>)(f)(X 1 ). (24) 

Proof. It follows immediately from ([4]) that the expectation of f{X n+ i) condi- 
tionally to the state at time n is 



E^f(X n+1 ) = V — -h(X n )f(X n + w k ) 

£ — ' n + n — 1 



Kfc<s 



f(X n ) + — V l k (X n )(f(X n + w k )-f(X n ) 

n + n — 1 * — ' \ 



n + t\ — _ 

l<fe<s 

By definition of the transition operator <J>, this formula can be written as 

E^f(X n+1 ) = (ld+— -*) (f)(X n ); (25) 

V n + n — 1 J 

taking the expectation leads to the result after a straightforward induction. ■ 



It follows from Proposition 14.11 that the asymptotic weak behaviour of the 
process, or at least the asymptotic behaviour of its moments is reachable by de- 
compositions of the operator $ on suitable function spaces. Corollary 14. 2 1 is the 
first step in this direction, stating the result for functions that belong to finite 
dimensional stable subpaces. 
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Corollary 4.2 Let f : V — > W be a measurable function taking values in some 
real (or complex) vector space W. 

1- If f * s an eigenfunction of $ associated with the (real or complex) eigen- 
value z, that is if $(/) = zf, then 

Ef(X n ) = n* r(T * } , /(X0 + O (n- 1 ) 

r(n + z) 

as n tends to infinity (T is Euler's function). 

2- Assume that f is nonzero and belongs to some ^-stable subspace S of mea- 
surable functions V — > W and that the operator induced by $ on S is a sum 
zlds +$tv, where &n is a nonzero nilpotent operator on S and z a complex num- 

v N (f)^0 and ^+ 

Ef(X n ) = - 7 -- ;y\> . <frfr(/)(Xi) + 0(n'log'' 



ber. Let v be the positive integer such that $^(/) ^ and (/) = 0. Then, 



n 



n z \og v n r(n) ^ 
T(ri + z 

as n tends to infinity. 

PROOF. 1- It follows from Proposition [O] that Ef(X n ) = 7 Tl ,ra(z) x /(Ai). Note 
that, as soon as the terms are defined, 

Y{t\ + t) T(n +Ti — 1) 

so that the result is a consequence of Stirling Formula. 
2- Taylor expansion of 7 T1-n (zId +4>jv) leads to 



Ef(X n )=J2^n( Z W N (f)(Xl) 



p>0 " 

(finite sum), where 7^ > ,n denotes the p-th derivative of 7 Tl ,n- Besides, if p is any 
positive integer, 

7 <&(*) = n z log" n r(T j + O (n 2 log"- 1 n) (27) 

r(n + z) 

when n tends to infinity, as can be shown by Stirling formula (sec (|26|) ) and an ele- 
mentary induction starting from the computation of 7 Tlin 's logarithmic derivative. 
These two facts imply the result. ■ 

Remark 4.3 As it is written, Corollary 14.21 is valid only if the complex number 
Ti + z is not a nonpositive integer. We adopt the convention l/T(w) = when 
w € Z<o, so that this corollary is valid in all cases. 

Remark 4.4 If / : V — > W is linear, formula implies that $(/) = / o A. In 
that particular case, formula (f24"|) gives Ef(X n ) = f o r ) Ti n {A)(Xi). This fact will 
be used in the proofs of Theorems 13.51 an 13.61 when / is a linear combination of 
projections Wk (see Section [5]). 
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4.2 Action of $ on polynomials 

Because of Condition ^ in the definition of a Polya process, none of the vectors 
is zero. For any k, if / is a function defined on V, we denote by df /dw^, when 
it exists, the derivative of / along the direction carried by the vector w^. With 
this notation, we associate with the finite difference operator $ the differential 
operator <j>g defined by 




for every function / defined on V and derivable at each point along the directions 
carried by the vectors Wk's. When / is differentiable, can be viewed as 

a "first approximation" of $(/). As derivation behaves good with respect to 
product of functions when finite differentiation does not, is helpful for the 

understanding of <&'s action on polynomials. 

Remark 4.5 The differential operator can be written as < i ) a(/)(w) = Df v .Av for 
any differentiable function /, where Df v denotes the differential of / at point v. 
This can be readily seen from the formula Df v .Wk = ~§^( v )- 

Proposition 4.6 (Action of $g on the u-monomials) For any choice of a 
Jordan basis (uk)i<k<s of linear forms of a Polya process, 

1- for every a € (Z>o) s , 

$ a (u Q ) - (a, A) u" G Span{u' 3 , (3 < a}; 

2- if a £ (Z>o) s is a semisimple power, then $g(u Q ) = (a, A) u Q . 

Proof. $3 is a derivation, as can be seen directly or from Remark 14.51 In 
particular, for any a £ (Z>o) s , 

s 

$ a (u«) =£a fe u Q - s *$ a (u fc ). (29) 
fe=i 

Besides, as any uu is linear, &d(v,k) = itfc ° A. The conclusion follows from Jordan 
basis' Definition ^. 31 (the degree-antialphabetical order on s-uples is defined in (JT5J) 
at the end of Subsection 12. 2[) . ■ 

Remark 4.7 One can formally extend the result of 2- in Proposition 14.61 to any 
family of complex numbers ai, . . . , a s when Vfc, k =/= is eigenform of A. 

This gives other eigenfunctions of $3, defined on suitable open subsets of V or Vc 
(usual topology). 
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We can now prove Proposition l3.11 as it was announced in Section[3] It appears 
as a direct consequence of Proposition [46j 

PROOF of Proposition 13. 11 The family (u^)^^^! constitutes a basis of poly- 
nomials of degree < \a\ — 1. Hence, if F denotes the subspace F = Span{u^, (3 < 
a}, Taylor formula implies that (<£> — <£>g)(u Q ) 6 F. Moreover, $a(u Q ) — (a, A) u Q e 
F because of Proposition 14.61 This completes the proof. ■ 

4.3 Reduced polynomials 

Choose a Jordan basis of linear forms (uk)i<k<s of a Polya process. For any a € 
(Z>o) s , the reduced polynomial of rank a, denoted by Q Q , was defined in Defini- 
tion !3.2l as the projection of u Q on ker($— (a, A})°° parallel to (J)^^ X ) ker(<I>— z)°° 
(see (f2TJf for the meaning of notation ker ip°°). Properties of these polynomials that 
are listed in Proposition ^. 81 will be used in the sequel. Subspaccs S a were defined 
in IP]). 

Proposition 4.8 Let a 6 (Z>o) s . 

(1) Qa = 1 and Q a — u a if \a\ = 1; 

(2) {Qp, (3 < a} is a basis of S a ; 

(3) for every z £ C, {Q a , (a, A) = z} is a basis o/ker(<I> — z)°° ; 

(4) Q a -u a e Span{Q^, 0<a, ((3, A) ^ {a, A}}; 

(5) *(Q„) - (a,X)Q a £ SpanlQ^, /3 < a, </3, A) = (a, A)}. 

Proof. (%) comes directly from the dchnition of a Jordan basis and (2) from 
the ^-stability of subspaccs S a (see (jT9j) ) . Any Q a belongs to the characteristic 
space ker($ — (a, A})°° and the eigenvalues of the restriction of <& on polynomials 
are exactly the (a, A) (see Section [3l consequences of Proposition ^. ip . These facts 
imply (3). Property (4) is obvious from Q Q 's definition, when (5) follows from (3) 
and Proposition 13. II ■ 

Assertions (4) and (5) in Proposition 14. 81 can be used to compute the reduced 
polynomials inductively (see Remark l4.9l belowV Let's define, as it was announced 
in Section[TJ the complex numbers q a ^p by the relations u Q = Q a + J2p< a a a,f}Qp, 
their existence and unicity being guaranteed by Assertions (2) and (4) in Propo- 
sition [478] Moreover, because of (4), q a ,/3 = as soon as (/3, A) = {a, A), so that 

u Q = Q Q + J2 1<x >0 Qp- (30) 

This relation, still too rough to lead to the main results on asymptotics of large 
Polya processes, will be refined in Subsection 14.51 
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We end the present subsection by giving two remarks concerning the inductive 
computation of all reduced polynomials and a closed form for projections of the 
powers of u\. 

Remark 4.9 Inductive computation of Q Q 's. 

In the general case, the numbers q ai p and the numbers p a .p defined by 

($ - {a, X))(Q a ) = ^ VafiQfi = ^2 Pa,f}Qf3 

(see (5) in Proposition 14. 8p can be inductively computed (and implemented) the 
following way. We denote by r Qji g the complex numbers defined by 

($-<a ) A»(u a ) = 5^r a , /J Q /J , (31) 

/3<a 

that can be deduced by plain computation of ($ — (a, A))(u Q ) and its expansion in 
the (Qp)p< a basis with the help of formula (|30[) . the corresponding numbers qp n 
being known by induction. Write two expressions of ($— (a, A))(u") with formulae 
(|3ll|) and (f3"Tj) and identify the coordinates in the {Qp) basis. This provides the 
following equations with p a ,p and q aj p as unknowns: 

!(/?, A) = (a, A) r a .p = p a> p 

{13, X) ^ (a, A) r a)/ g = ((/?, A) - (a, X)) q a ,p + q a , 7 P 7 ,p- ( 32 ) 

/3<7<a 

The expansion of Q Q in the (u' 3 ) basis can be obtained by reversing the triangu- 
lar system written in (|30[) . All these computations can be handled by means of 
symbolic computation. 

Remark 4.10 Closed formula for Qps^s. 

An immediate computation shows that the reduced polynomials corresponding to 
powers of u\ are the same ones for all Polya processes: for any integer p > 0, 
$ [ui(ui + 1) . . . (ui + p — 1)] = pui{ui + 1) . . . (ui +p — 1), so that if follows from 
Proposition 14.81 that Q p s 1 = u\{ui + 1) . . . (u\ + p — 1). The powers of u\ are 
thus always expressed in terms of reduced polynomials Q p s 1 's by means of Stirling 
numbers of the second kind (for this inversion formula, see e.g. \12\): 

k=l ^ J 

This common formula has to be related to the non random drift, consequence 
of ©: Vn, ui(X n ) = n + n - 1. 
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4.4 Cones in the space of powers 



As it was explained in Section [TJ it follows from reduced polynomial's definition 
that the behaviour of the EQp(X n ) are ruled by Corollary 14.21 Thus, the asymp- 
totics of the u-moment 

Eu a (X n )=EQ a (X n ) + J2 QcpEQpiXn), (34) 

0<a, (/3,A)#<q,A) 

when n goes off to infinity, depends on the answer to the following two questions: 

(1) which g Qi| g are zero in Relation (|30l) ? 

(2) For a given a, which 5J(/3, A) is maximal among indices j3 < a such that 
q a ,p + 0? 

Optimal answer for the most general Polya process is expressed in terms of a 
rational cone £ and a rational polyhedron A a in the "space of powers" R s = Z S <X>R. 
The two following paragraphs are devoted to these subsets; at the end of each of 
them, wc give properties of the number A) when (3 belongs respectively to E 
or some A a (Propositions 14.151 and 14. 19)) . 

Note, as suggested by the anonymous referee, that the argument given in Re- 
mark 15.51 enables one to by-pass Sections 14.4.11 and 14.51 giving the construction of 
the cone £ and the study of its properties. 

4.4.1 Cone E 

Notations: if / C {1, . . . , s] and G {1, . . . , s} 2 , we adopt the notations 

l<i<s iel l<i<s iel 

Sfaj-) = 2Si - Sj e M. s and 5% ^ = 2dx l - dxj G R s * 

where dxk denotes the k-th coordinate form (x\, . . . , x s ) i— > Xk in the dual space 
W* and where Sk is the fc-th vector of the canonical basis of M s , already defined 
in 

Definition 4.11 We denote by E the polyhedral cone ofR s spanned by the s(s — 1) 

vectors Snj\ for all ordered pairs of distinct elements, i.e. 

£= R >o<5(^')- (35) 

(i,j)e{l,...a}, i& 

This cone is convex, and the half-lines spanned by vectors Suj) are extremal 
(edges). As usual, we define the dual cone E of E as 

£ = {x G K s ,Vy G E, (x,y) > 0}, 
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identified to the cone of all linear forms on R s that are nonnegative on £, via the 
bijective linear application x £ K s i— ► (x, .} £ M. s * (the symbol (x,y) denotes the 
standard scalar product of x and y in R s ). Lemma T4.12I describes the dual cone 
£ as a minimal intersection of hyperplanes (faces) and gives a system of minimal 
generators (edges). Corollary 14 . 1 41 i ust transcribes Lemma T4. 121 in the £-sidc and 
gives the equations of the faces of £. We give a complete geometrical description 
of S; it presents some "universal" character, as shown in Remark 14. 161 

Lemma 4.12 (faces and edges of £) 

£ = H {*eR s , 6* {hj) (x) >0}= ]T R> Si. 

(ij')e{l,...s}, i^j /C{l....,s} 

l<#I<s-l 

Proof. The first equality that describes the faces of £ comes directly from (j3"5)) . 
For every permutation w £ & s , let t w be the simplicial cone defined by 

t w = {x £ R s , x w{s} < a; w(s _!) < • • < x w(1) < 2x w{s) }. 

The cones t w provide a subdivision of £ in s! simplicial cones -this subdivision is 
the intersection of £ with the barycentric subdivision of the first quadrant of W . 
Each t w is the image of t\ = rid by the permutation of coordinates induced by w 
(and t\ is a fundamental domain for the group action of & s on £ by permutations 
of coordinates). Because of the elementary computation 

(x 1 ,x 2 ,x 3 ,X4) = (2x4 -a:i)(l, 1,1,1) 
+ (x 1 -a;2)(2 J 1,1,1) 
+ (x 2 -.t 3 )(2,2,1,1) 
+ (x 3 -ar 4 )(2,2,2,l) 

that can be straightforwardly generalized in all dimensions, one sees that the edges 
of r\ arc spanned by (1, . . ., 1) = 8$ and Snx, <5{i.2},- ■ ■ , ^{i,....s-i}- The images 
of these last s — 1 vectors under permutations of coordinates are exactly the 5j, 
where I ^ and I ^ {1, . . . , s}. This completes the proof. ■ 

Remark 4.13 Vectors 8% = J2i<k<s ^ k ano - = 2<?0 belong to £, and 

this fact will be used in the sequel. They do not appear in the second sum of 
Lemma 14.121 because they do not span an edge of £. On the contrary, the vector 
8 1 spans an edge of £ when / is neither empty nor the whole {1, . . . , s}. 

Corollary 4.14 (faces of £) The cone £ has 2 s — 2 faces of dimension s — 1, 
described as 

£ = p| {x£R s , 8}(x) > 0}. (36) 

/C{l,..., s } 
1<#-T<s-1 
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In dimension two, E is spanned by (2,-1), and (—1,2) and E by the forms 
2dxi+dx2 and dx\+2dx2- In dimension three, E is spanned by (2,-1,0), (—1, 2, 0), 
(2,0,-1), (—1,0,2), (0,2,-1) and (0,-1,2) and the coordinates of the spanning 
forms of E are (2,1,1), (1,2,1), (1,1,2), (2,2,1), (2,1,2) and (1,2,2) in the canon- 
ical basis (dxi,dx2,dx3). The numbers of edges of E and E coincide only in di- 
mensions 2 and 3. Figures [1] and [2] give pictures of E in dimensions 2 and 3; in 
these figures, the comments that contain occurences of the greek letter 77 refer to 
further developments (see Remark 14.211 in Subsection 14.5ft . 




{a - 77, 77 > 0, M > 2} {a - r, + 6 k , r, > 0, \r,\ > 2, k £ {1,2}} 

Figure 1: cone E and related sets in dimension 2 



(2,-1,0) (2,0,-1) 




(-1,0,2) (-1,2,0) 

Figure 2: trace of E (convex hull) and of {rj — 8k: V > 0, |?7| > 2, k £ {1,2,3}} 
(union of three triangles) on the hyperplane {x\ + X2 + £3 = 1} of R 

Notation: for any B C W and a £ K s , we denote 

B - E = {B - cr, a £ E} and a - E = {a} - E. (37) 
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Proposition 4.15 Take a Pdlya process, choose any Jordan basis and denote A = 
(Ai, . . . , As) its root's s-uple (see l{14\))- Let a € (Z>o) s and (3 G (Z>o) s fl (a— E). 

1- If a is a power of large projections, then a = /3 or K(/3, A) < 5R{a, A). 

2- If a is a power of small projections, then 5ft(/3, A) < \\ct\. 

Proof. See Definition 12.81 in Subsection 12.21 for definitions of powers of large or 
small projections. We denote a = a — (3 G E and split {1, . . . , s} into the three 
disjoint subsets / = {fc, K(A fc ) > \, a k < 0}, J = {fc, K(A fc ) > \, a k > 0} and 
K = {k, 5ft(A fe ) < §}. 

1- If a is a power of large projections, then any a k (k G K) vanishes. Since 
a — (7 > 0, this implies that a k < for all k £ K. Thus, 

a) > 53 a k + \ y; + lYl a * = \ 5 ^)- ( 38 ) 

kei keJ kei< 

Since a lies in E, the number Sj(a) is nonnegative (see (f3"6")l ). Besides, <7fe < for 
any k & K so that there exists some fc G / U J such that cr^ > because the only 
point of E with only nonpositive coordinates is 0, as can be seen on E's equations 
(Corollary 14. 14p . Thus J ^ and the inequality of (J38|) is strict. 

2- If a is a power of small projections, then k G / U J a k = 0. Thus 

(A A)<^ K - c- k ) - W °>° - E a * = \\ a \ - \ 5 *^)- 

keK fee./ kei 

Since a lies in E, the number <5/(<r) is nonnegative. ■ 

Remark 4.16 Assertion 1- of Proposition 14. 151 is not far from being an equiva- 
lence in the following sense. 

Claim For any a = (cti, ■ ■ ■ , a s ) G (R>o) s , the following are equivalent: 
(1) Vfc G {1, . . . , s}, 5R(A fe ) < 1/2 a fe = 0; 
V/?G (M>o) s n(a-E), 5R(/3,A) < K(a,A). 
PROOF. Note first that (2) is readily equivalent to (2'): Vcr G E, a - a > 
=>• 5ft(er, A) > 0. The proof of implication (1)=>(2') is essentially the same as 
in Proposition 14.151 To show the contrapositive of (2')^(1), let k be such that 
^(Afc) < 1/2 and a k > 0. Let a = ^a k (2S k — Si). It follows immediately from ([33)1 
that cr G E. Furthermore, a — a > and 3?((T, A) = a k (di(X k ) — i) < 0. ■ 

This claim gives another "universal" aspect of the cone E in the phase transition 
phenomena between small and large processes (see Relation ([34]) , Theorem 14.201 
and proof of Theorem 13. 4[) . 

4.4.2 Polyhedra A a 

Take a Polya process and fix a Jordan basis of linear forms (Mfe)i<fc< s . Notations 
relative to this basis are defined in Section [2] Remember that S k is the fc-th vector 
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of the canonical basis of W . 

Definition 4.17 For any a £ (Z> ) s , let A a be the subset of (Z> ) s defined by 

A a = (a-D a )n (Z> ) s , (39) 

where D a is the set of M.>Q-linear combinations of all vectors 5k — 5k— i such that 
au > 1 and Ek = 1 (as in \31\ ), a — D a denotes {a — d, d £ D a }). 

These subsets are finite because (3 < (3 — 5k + <5fc-i for the dcgrce-antialphabetical 
order defined by (fT8|) . Geometrically speaking, A a is the set of integer points 
of the convex compact polyhedron of codimension > 2 defined by intersection of 
(K>o) s with the rational cone a—D a (and A a itself is abusively called polyhedron). 
When a is a semisimple power, all vanish so that D a = (0) and A a = {a}. The 
polyhedra A a play thus a role only for non semisimple Polya processes. Properties 
of A a 's that will be used in the sequel are listed in the following proposition. 
Definition of the differential operator $g was given in (|28|) . 

Proposition 4.18 Let a £ (Z>o) s . 

1- If a is a semisimple power, then A a = {a}. 

2- If a is a power of large (respectively small) projections, then every element 
of A a is a power of large (resp. small) projections. 

3- a S A a and Spanju' 3 , (3 £ A a } is &g-stable. 

Proof. Justification of 1- was given just before Proposition ^. 181 If a is a power 
of large (respectively small) projections, Assertion 2- can be deduced from A^s 
definition (|39|) by induction on a (dcgrce-antialphabetical order): if > 1 and 
Ek = 1, then a~5k + 5k-i is < a and a power of large (resp. small) projections. It 
remains to prove 3-. Assertion a £ A a is an obvious consequence of Definition ^. 1 71 
Moreover, Jordan basis properties (see Subsection 12. ip imply that $o(iti) = u\ 
and $a(wfe) = AfeUfc + EkUk-i if k > 2, where £fc E {0,1}. Formula (|2"§|) shows 
that for every [3, $g(u^) — (/3, A) u' 3 is linear combination of polynomials u 7 , where 
7 = /3— 5k+5k-i for integers k > 2 such that (3k > 1 and = 1 (hence Afe = Afe_i). 
These considerations suffice to prove 3-. ■ 

Proposition 4.19 Take a Polya process, choose any Jordan basis and denote 
A = (Ai, . . . , A s ) its root's s-uple (see \14\) )- Then, for every a, a 1 £ (Z>o) s , 

a' £ A a ==> (c/, A) = (a, A) (40) 

Proof. If (3, 7 and k are like in the end of Proposition [4~T8l s proof, (7, A) = ((3, A). 
This fact leads to the result. ■ 
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4.5 Action of $ on polynomials (continued) 

Adopting notations of Section I4T41 we define, for any a G (Z> ) s the subspace S' a 
of S a as 

S' a = Span{u^, /3eA a - E}. (41) 

Theorem 4.20 Xafce a Polya process, choose a Jordan basis (uk)i<k<s and let 
(Qa)aG(Z >0 ) s be the corresponding reduced polynomials. 
1- For any a G (Z>o) s , 

S' a is $ - stable; (42) 
= S P an{Q /3 , /3 e A a - £}. (43) 
If a is a power of large projections, then Q(Q a ) G Span{Q^, /3 G A a }. 

Consequently. Relations ([50)) can be refined in the general case by means of (|4"3")l 
and Proposition 14. 81 this provides straightforwardly 

u a = Q a + q a ,pQ fj . (44) 

Proof. 7- We first prove that S' a is $-stable. Let (3 G A a — £; let a' G A Q and 
cr G £ such that (3 = a' — a. We show that both <I>a(u' 3 ) and ($ - $g)(u^) belong 

to fir;. 

• As in Proposition I4.18l s proof, $^( u/3 ) — (P,^) u is a linear combination of 
polynomials u 7 , where 7 = /3 — 6k + 6k-i for integers ft > 2 such that /3fc > 1 
and £fe = 1 (hence = A/-_i). If 7 is such a power, we claim that 7 G A Q — £, 
which shows that $g(u' 9 ) G S^. If a' fc > 1, just write 7 = a" — cr where a" = 
a' — <5fc + 6k— 1 G A Q . If a' k = 0, this a" is not in A a because it is not nonnegative; 
in this case, write 7 = a' — cr' where cr' = cr + <5fc — £fc_i. It suffices to show 
that cr' G E. Let 7 be a proper subset of {1, . . . , s}, that gives the equation of a 
face of E (see Corollary 14.141) . If ft G / or ft — 1 ^ 1", then <5f(cr') > because 
<JJ(cr) > 0. If ft £ / and ft-1 G /, thcn^(cr') =6* T (a)-l = 6* u{k} (a)-o- k -l; but 
a k = — /3fc < —1 because (3k > 1. Thus 6j(cr') > 6j u ^ k y(a) > since cr G £ (note 

that this last inequality is true even if I U {k} = {1, . . . , s} because (1, . . . , 1) G E, 
see Remark f4. 13[) . 

• Taylor formula implies that ($ — $a)(u^) is linear combination of polynomials 
u 7 — u P—n+Sk w ith 1 < ft < s, 7] > 0, |?7| > 2, /3 — ?y > (the 77-terms correspond 
to partial derivatives of order > 2 of u' 3 , the (5fc-terms come from the expansion of 
linear forms Ik in the Jordan basis (uk)k)- If 7 = (3 — rj + 6k is such a power and if 
6 j is the equation of any one of the defining hyperplanes of E where / is a proper 
subset of {1, . . . , s} (see Corollary 14. 14[) . then 

W - 7) = ~ h) = \v\ ~ 1 + Yl - Ifcei > 1 - lfc€J + E % ^ °" 



N. Pouyanne: Polya processes, April 2005; revised September 2006 



26 



This proves that ($ - $ s )(u^) belongs to Span{uT, | 7 | < \p\ _ i j 7 e /? - E}. If 
7 = /3 — — E, then 7 = a' — (a + a') 6a'-S because the cone E is stable 

under addition. This shows that (<& — <I>g)(u^) e 5^ (see Figures Q] and [5] for a 
representation of powers f3 — 7 = r/ — 5k that appear in this computation). 

Thus, S' a is a $-stable subspacc of £ Q . For any j3 G Aq, — E, the projection 
of u* 3 on n ker($ - (AA)) 00 parallel to S£ n ©^ (/3 , A > ker ($ ~ ecmals 
<5/3 because of the unicity of the decomposition on characteristic spaces. Hence 
Qp G S' a (another way to show that fact consists in noting that the projections 
on these characteristic spaces are polynomial functions of the restriction of <& to 
S' a ). Thus, SpanjQ^, /3 G A a — E} is a subspace of S' a ; as these two subspaces 
have the same finite dimension, they are equal. The proof of 1- is complete. 

2- Because of Assertion (5) in Proposition [4?8] and of the <&-stability of S' a , 

$(Q Q ) G SpanjQ^, a < /3, /3 G A Q - E, (/3, A) = (a, A)}. 
Conclude with 1- of Proposition 14. 151 and Proposition 14. 191 ■ 

Remark 4.21 (On the minimality of cone E and polyhedra A a ) 

Cone E appears in a natural way in the proof of Theorem 14.201 to ensure the 
^-stability of a (minimal) subspace that contains some given u Q . Indeed, suppose 
for simplicity that a is a semisimple power. Then $(u Q ) is the sum of (a, A) u Q 
and of a linear combination of polynomials u Q_ ' ,+<5fc where 77 > 0, \rj\ > 2 and 
1 < k < s. The iterations of $ on such polynomials force to consider the least 
(for inclusion) set of powers that contains these rj — Sk and that is stable under 
addition (and contains zero); this least set is E. For an illustration of this fact, 
see Figures Q] and [2] If a is not semisimple, the situation is complicated by other 
powers a' of same total degree and leads to consider the polyhedron A a . 

Suppose that B C (Z> ) s is such that a G B and Span{u^, (i G B} is in- 
stable. As in the end of Proposition ^. 181 s proof, Formula ([29)) shows that A a C B, 
so that A a is minimal for properties 3- of Proposition 14.181 These properties are 
necessary to imply Formulae (|431> and {44]) . The optimality of A a , announced in 
the introduction of Subsection 14. 4[ consists in that fact. 

A shorter proof of Theorem 13.41 can nevertheless be given without consider- 
ing E. See Remark l5.5l 

5 Proof of Theorem 13. 4L asymptotics of moments 

The proof of Theorem 13.41 relics on Formula pi)) in which the expectation of the 
value at X n is taken, providing 

Eu a (X n )=EQ a (X n )+ J2 q a ,pEQ fJ (X n ). (45) 
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We first use Corollary 14.21 to make asymptotics of reduced moments EQp{X n ) 
precise in Proposition 1 5 . 1 1 before giving a proof of Theorem 13.41 Numbers v a were 
defined by (|2"Tj) and appear naturally in Thcorcm l3.41 Subsection 15. 21 is devoted to 
their computation in the case of powers of large projections. 

5.1 Proof of Theorem 13.41 

Proposition 5.1 (Asymptotics of reduced moments) Let a £ (Z>o) s . 

1- If v a = 0, i.e. ifQ a is eigenfunction o/$, then, as n tends to infinity, 

EQ a (X n ) = - ^ Tl) g a (^) + Oin^- 1 ). 

r(n + {a, A)) 

2- If v a > 1, then, as n tends to infinity, 

EQ a {X n ) = 1 )y (<P-(a,\)y«(Q a )(X 1 ) 

v a \ r(Ti + (a,A); 

+ 0(n< Q < A > log"" -1 ™). 

Proof. Q a belongs to the 4>-stable subspace S(a) = ker($ — (a, A))°° and the 
operator induced by <E> on S(a) is the sum of (a, A) Idg^) and of the nilpotent op- 
erator induced on 5(a) by $ — (a, A). This facts being considered, Proposition l5.ll 
is a straightforward consequence of Corollary 14.21 ■ 

Remark 5.2 Even if a is a semisimple power, Q a may not be an eigenfunction 
of $. This happens only if (a, A) = (/?, A) for some (3 < a because this implies 
that both Q a and Qp are in the same characteristic subspace of $. When all roots 
Xk arc incommensurable, i.e. whenever they admit no non trivial linear relation 
with rational coefficients, all numbers (a, A) arc distinct, so that every Q a is an 
eigenfunction of $. 

Proof of Theorem 13.41 Proposition 15 . II asserts in particular that for all (3 < a, 
there exists v > such that EQp(X n ) £ O (n R ^' A > log" n). 

1- If a is a power of small projections, then any a 1 S A a satisfies \a'\ = \a\ and 
is a power of small projections (Proposition I4.1g)l . Hence nA^' A ' E O (n' Q l/ 2 ) if 
j3 6 a' — S, as can be deduced from Proposition ^. 151 

2- If a is a power of large projections, then any a' S A a satisfies {a' , A) = (a, A) 
and is power of large projections. Hence, for every j3 G a' — E, a' = (3 or A) < 
3?(a, A) fProposition l4.15l and Proposition ^. 19p . Thus, Formula (|4l)|) . implies that 
Eu a (X n ) = EQa(X n ) + o(n !R ( Q ' A ^) has the required asymptotics as it can be 
deduced from Proposition [5TT] 

3- Moreover, if a is a semisimple power of large projections, then v a — (conse- 
quence of Theorem W7M (2-). Proposition Ei~Tgl and u a 's definition l[2Tp). We 
conclude with Proposition [5Tj ■ 



N. Pouyanne: Polya processes, April 2005; revised September 2006 



28 



Remark 5.3 In Theorem 13.41 Assertion 3- is a particular case of Assertion li- 
the constant named c appearing in 2- being 

-($ - (a,X)) Va (Q a )(X 1 ). 



v a \T( ri + {a,\)) 
This follows from Proposition 15.11 and from Theorem I3.4[ s proof. 

Remark 5.4 More precision on the small o of Assertion 3- in Theorem 13.41 can 
be deduced from its proof: one can replace it by O (n a ) where 



a = max 



({5R(/3, A), ft^a, ft £ a - £} U {R{a, A) - 1}). 



Remark 5.5 One can give a shorter proof of Theorem 13.41 without explicitely 
considering S. The following arguments, that provide a self-sufficient independent 
proof, have been suggested by the anonymous referee. For any ft = (fti, . . . , ft s ) £ 
(Z> ) s and any z £ C, let's define /3[ z ] = J2i<k<s \ k=z h (this number being 
by convention if there is no k such that Xk = z) , and let 



p £ (z> ) s , A*] + 2 E A«] ^ 

2, /3 W >0 z, W <O 

Then T is stable under addition (it is a convex cone) and the subspace F a = 
Span-ju' 3 , p £ (Z> ) s n(a-r)} is thus ^-stable as can be seen from Equation (|29|) 
and from the proof of Proposition 13.11 page [T9l The fact that F a is <i>-stable 
implies that Qp £ F a for all ft £ (Z + ) s (~1 (a — T); indeed, can be seen as the 
projection of u 13 on F Q n kcr($ - (/?, A))°° parallel to F a n A ) kcr($ - z)°°, 

because of the unicity of the decomposition on characteristic spaces. Therefore, 
F a = Sp&n{Q/3, P £ (Z>o) s n(a — r)}. Besides, T has the following two properties: 

(a) if a is a power of large projections, then ft £ a — T and {ft, A) ^ (a, A) 
imply 5R(/3,A) < 5R(a,A); 

f&J if a is a power of small projections, then §t{ft, A) < |a|/2 for any /3 £ 

(z> ) s n(a-r). 

[Proof of (a,): if 7 = a — ft is such that (^[ Z ]) Z £C Oj then 



7fc>0 7fc<0 



2 

7k >0 7fc<0 



Assertion (b) follows from a similar argument.] 

These two properties suffice to show Assertions 1- and 2- in Thcorcm l3.4l Likewise, 
Theorem 14.201 2- and Theorem 13.41 3- can be obtained by the following refinement 
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of the argument: Span{u^, (i <E A a or /3 = a — a, a G T, (erM^ec ^ 0} is 
^-stable. 

In any case, £ C T. When all roots of the process are distincts, then T = S. 
Otherwise, the cone T (more precisely r ® R) is not strictly convex (it contains a 
nonzero vector subspace of R s ). Consequently, since S is strictly convex, r = E 
if and only if all roots of the process are distinct. Compare this fact with the 
minimality of £ asserted in Remark 14.211 

5.2 Computation of nilpotence indices v a 

For any a, £ (Z> ) s , the number v a has been defined in Section[3]as the nilpotence 
index of Q a for $, i.e. 



It appears in the expression of the leading term of the u-moment Eu a (X n ) as n 
tends to infinity, when a is a power of large projections (Theorem 13. 4[) . 

In several problems where these moments' asymptotics are needed, it is useful 
to compute them explicitely. To this end, iterations of the finite difference opera- 
tor <!> are not easily handled; furthermore, a calculation of v a from its definition 
supposes that the reduced polynomial Q a has already been computed. These two 
facts make a direct computation of v a rather intricate. Whenever a is a power of 
large projections, Proposition asserts that v a is the nilpotence index of u a for 
the differential operator $3, making its computation much easier. 

Proposition 5.6 (Computation of v a ) 

1- If a is a power of large projections, then 



2- If a — (oil, ■ • ■ ,a s ) * s a monogenic power of large projections whose support 
is contained in the monogenic block of indices J — {to, . . . , to + r} (r > 0), then 



Proof. 1- There is nothing to prove if a is a semisimplc power. We thus 
suppose that a is a large and not semisimple power. We denote by k a the index 
k a = min{fc > 3, ak > 1, £k = 1} and p(a) the element of A a defined by 
p(a) = a — Sk a + Sk a -i] it is the predecessor of a for the degree-antialphabetical 
order restricted to A a . As a direct computation of $a(u Q ) shows (see (f2l?f in the 
proof of Proposition [4?6]), Proposition 14. 181 implies that 



v a = max{jp > 0, (* - (a, X)) p (Q a ) f 0}. 



v a = max{g > 0, ($a - (a, A)) 9 (u Q ) £ 0}. 



r 




k=0 



($8 - A))(u Q ) - a ka up( q ) e Spanju' 3 , (3 € A a , (3 < p(a)}. 



(46) 
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We claim that ($ — (a, X))(Q a ) — ak a Q p ( a ) £ SpanjQ^, < p(a)} (proof just 
below). With Theorem l4.20[ as a is a power of large projections, this implies that 

($ - (a, A))(Q„) - a ka Q p[a) G Span{Q,3, G A a , < p(a)}. (47) 

Assertions (|46p and (|47|) are then sufficient to show that 

max{ g > 0, ($ - (a, A)) 9 (Q Q ) ^ 0} = max{g > 0, ($ a - {a, A)) 9 (u Q ) ^ 0}, 

this number being equal to min{q > 0, p^ (a) is a semisimple power} (notation 
p^ denotes the composition p o . . .p iterated q times and p^(a) = a). 

It remains to prove that ($ — (a, X))(Q a ) — ctk a Q P ( a ) £ Span{Q/3, (3 < p(a)}. 
Note first that \p{a)\ = |a|, so that (3 < p(a) as soon as \0\ < |a| — 1. Since $ — $9 
let the degree fall down (Taylor formula), 

(* - (a, A»(Q a ) G ($ fl - (a, A»(Q„) + SpanK, < |a| - f }. (48) 

The only point of E having a nonpositive degree (|.|) is zero, so that Theorem l4.20l 
leads to 

Q a e u" + Span-ju^, < \a\ - 1} + Span-ju^, /? < a, /3 G A a }. 

Taking the image by <&g — (a, A) of this last relation leads, using (|48|) to 

(*- (a,A))(Q a ) G (a,A))(u Q ) + Span{iA /3<p(o)}. 

Because of Assertion (j46]). 

(* - (a, A»(Q a ) G u^ Q ) + Span{u^ < p{a)}. 

The conclusion follows from Proposition [48] (Assertions 2- and 4~)- 

2- The total degree \a\ being fixed, we proceed by induction on a. If a is 
semisimple, a = \a\5 m and v a = 0; there is nothing to prove. If a is not semisimple, 
the computation of ($9 — {a, A))(u a ) shows that 

u a = l + max{i/ a _i t+ i t l , m+l<k<m + r, a k > 1}. 

All these a — 5 k + 5k— 1 arc < a and have total degree \a\; by induction, they all 
have the same v, this number being —1 + X)o<fc<r ^ a m+k- The formula for v a is 
proven. ■ 

6 Proofs of Theorems 13.51 and 13. 6L asymptotics of 
large processes 

Proof of Theorem 13.51 We adopt the notations of Section O Let's denote 
7r = J^ 2 <fc<r nk an d 7r ' = Sfc>r+i ""fci ^ ne random vector X n splits into the sum 

X n =ir 1 X n +Y n + Z n , (49) 
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where Y n = irX n and Z n = Tr'X n . 

• First term n\X n 

Definitions of the Jordan basis {uk)k of linear forms and of its dual basis (vk)k 
of vectors imply readily that tti(v) = ui(v)vi for any vector v. Thus, because 
of Relation ([5]), K\X n = nv\ + 0(1) as n tends to infinity; this projection is non 
random. 

• Second term Y n 

As follows from (fT5|) , Y n = Y^k=2 u k{X n )vk- Take any k £ {2, . . . , r}. Compu- 
tation of the expectation of Uk(X n+ i) conditionally to the state at time n gives 
E^UkiXn+i) = (1 + Afc/(n + T\ — l))uk{X n ) for any positive integer n (see (|2"5)l , 
Ufc is an eigenform of the process); this implies that (7 Tlj7J (\k)~ 1 Uk(X n )) n is a 
martingale (one can divide by 7 Tl .n(Afe) because Afe is not a negative integer). 
As Uk (complex conjugacy) is an eigenform associated to the eigenvalue Afe, it is 
a linear combination of eigenforms uz's, all associated with Afe. Thus, if q > 1 
is an integer, \u^ q \ is a linear combination of polynomials u°'s for some suitable 
semisimple powers of large projections a's such that (a, A) = 2q<72- This implies, 
thanks to Theorem 13.41 that 

E\ul q (X n )\ = 0(n 2 ^). 

Note that this is valid even if Afe is real. The martingales 7 Tli „(Afe) _1 Wfe(A„) are 
consequently all convergent in every L p space, p > 1. 

For every k € {2, . . . , r}, let Wfe be the (complex) random variable defined by 

w r u k{X n ) r(ri) - x . 

VVfc = hm TTTw r~TT = llm u k {X n /n k ) 

n-»+oo 7 Tl , n (Afc) 1 (Tl + Afe) n-»+oo 

the second equality coming from Stirling's asymptotics as n tends to infinity: 

7r 1 ,n(A)r(ri + A) = r(n)n A (l + o(l)), 

for every A ^ — n + Z< . This shows that 17, = E2<t<r nA '^"t + o(n <T2 ), the 
small o being almost sure and in V for any p > 1. 

Computation of joint moments' limits: if a = (0, a2, . . . , a r , 0, . . . ) £ (Z> ) s , 
a is a semisimple power of large projections and if one denotes W a = Yik , 
Theorem 13.41 implies that 

EW a = lim -±-Eu a (X n )= r ^ l} Q«(Xi). 
n-»+oo n\ a - A i 1 (ri + (a, A)) 

• Third term Z n 

Z n = J2k>r+i u k{X n )vk- We show that n~ a2 Uk(X n ) converges to zero almost 
surely and in every L p space (p > 1), for every A; > r + 1. Take any fc > r + 1 
and any integer g > 1. As above, TTk is a linear combination of uj's, all associated 
with the root Afe (even if u k and the u;'s are not necessarily eigenforms). Thus, 



N. Pouyanne: Polya processes, April 2005; revised September 2006 



32 



\u1 q \ is a linear combination of polynomials u"'s for some suitable a's that are 
powers of large (respectively small) projections if diXk > 1/2 {resp. if di\k < 1/2), 
such that (a, A) = 2qR\k- Because of Theorem 13. 4[ this implies in any case that 
E\u 2 k p (X n )\ G o(n 2 f ff2 ), which gives the L p convergence. Furthermore, let p be 



any positive integer such that 1/p < 2(<r 2 
1/p < 2<j 2 — 1 if not; for such a p, the series 



5RA fc ) if 5RA fe > 1/2 or such that 



;Uk(X n ) 



2p 



converges. The almost sure convergence to zero of n CT2 Ufc(X„) follows thus from 
the almost sure convergence of the series of nonnegative random variables 



E 



— — u k {X n ) 

TL 



2l> 



and the proof of Theorem 13. 51 is complete 



Proof of Theorem I3.61 We adopt the notations of Section[2] For any monogenic 
block of indices J, we denote by ttj the projection ttj = X^fcpj n k- 
• Claim If J is a monogenic block of indices associated with a root X having a real 
part a > 1/2, then 7 Tlj „(7TjA) is invertible and ~/ Tl . n (irjA)~ 1 irjX n is a martingale 
that converges in L p for every p > 1 (thus almost surely). If Mj denotes the limit 
of this martingale and if v = jfj — 1, then 

TT.jX n = 1<3 f U ^ r ^ Tl \, u min j(Mj)v mliK j + o {n a log" n) (50) 

v\ r(n + A) 

as n tends to infinity, the small o being almost sure and in L p for every p > 1 . 
Furthermore, almost surely and in h p for every p > 1, 

u min j{Mj) = y x lim f '-. (51) 

1 (Tl) n^oo n A 



• Proof of the claim. The endomorphism 7 rii „(7Tj J A) is invertible because every 
Id+7r,/j4/(fc + Ti — 1) is (its unique eigenvalue has a real part > 1). Since J is a 
monogenic block of indices, A and ttj commute. Thus M n — ~f Tlin (irjA)~ 1 irjX n 
is a martingale (see (f2"5")) with / = irj and Remark 14.41 in Subsection l4.1[) . We show 
that for any k £ J, the quadratic variation of the martingale Uk(M n ) is almost 
surely bounded, which suffices, thanks to Burkholder's Inequality for discrete time 
martingales (see [13] for example), to ensure that the projection Uk(M n ) is bounded 
in L p for every p > 1, hence the validity of the convergence part of the claim. 
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Without loss of generality, we can assume for simplicity that J = {2, . . . , v+2). 
If one denotes N = nj(A — A), then N commutes with A and satisfies N v ^ 
and N u+1 = 0; furthermore, elementary considerations on A, the u k s and the Vk's 
show that for any nonnegative integer q and for any k £ {2, . . . , v + 2}, one has 
iV 9 7Tfc = UkVk+q ii k + q < v + 2 and N q TTk = 0isfc + g>^ + 3. In particular, 
for any q, one can write A™ = N q (J2 keJ ^k) = J2 q +2<k<»+2 u k-q v k (with the 
convention iV° = 7rj). Hence, if f3 n — l/^f Tl .n (as formal series or rational fraction; 
we omit the parameter t\ for simplicity of notation), Taylor formula leads to 



v 1 

v+2 fk-2 \ 

= E E/^w «*■ 



(52) 



Thus, for any fc G {2 

Ufc(M n+ i) - u fc (M„) = J2 ^«+i( A ) 
One can write 



^ + 2}, one has u k (M n ) = J2q=o jpPn q) {\)u k _ q (X n ) and 



fe-2 



9=0 



Wfe- g (X„ + i) 



ft (A) 



(53) 



u fc-g(-^n+l) ^"i - - u k-q{X n ) 

ft (A) 



u fc- 9 (^ri+l — AC, 

ft A) 



1 



ft (A) J 



Ufc_g(X n ). 



The relation /3„(A) = (1 + A/(n + r x — l))/3 n+1 (A) implies, with Leibnitz formula, 
that 

Besides, definition of the process (X n ) n (Definition 1 1 . 1 [) ensures that X n+ i — X n £ 
{wi, . . . , w s } is almost surely 0(1) and consequently that X n is almost surely 0(n) 
as n goes off to infinity (elementary induction). Hence 



- ^ ~ u k - q (x n ) e 0(1) 



(54) 



&(A) 

almost surely, as n tends to infinity. With the same tools as for the derivatives of 
7n,n ( scc l|27|) ). for every nonnegative integer g, 

'log 9 n N 



, , _ ,_ 1)a ^£(n + A) 

n A 1 (ri) 



(55) 
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as n tends to infinity. Thus ([53")) . ([5"4"| and ([55)) lead to 

u k (M n+1 ) - u k {M n ) e 

almost surely as n tends to infinity. In particular, \uk{M n+ \) — u k (M n )\ 2 is almost 
surely the general term of a convergent series: the quadratic variation of the 
martingale (uh(M n )) n is almost surely bounded and the convergence part of the 
claim is proved. 

Almost surely and in L p for every p > 1 , 

irjX n = j Tun (irjA) ['y Tl ,n(' K jA)~ 1 irjX n ] = j Tun (irjA)(Mj + o(l)) 

as n tends to infinity. As for equation (|52|) . one has 




and the asymptotics of the derivatives of j Ti n ( see (|27|l) implies 

= nMog^n r(n) + o 

f ! r(ri + A) 

which is the expected result ([501) on n J^n- Equation ([5!?]) shows that ii2(A/ n ) = 
/3 n (A)tt2(A„) and makes the proof of the claim complete with the help of ([551) . 

• As in the proof of the large and principally semisimple case (Theorem 1 3 . 5 [) , 
TTiX n = (n + t\ — f)«i, and the process splits into the sum 

T 

X n = nvi + ^ KJkXn + Y n + Z n 

k=2 

where Y n = y] T irjX n the sum being extended to all monogenic blocks of indices 
different from any J k that correspond to roots having real parts > 1/2 and Z n = 
J2{k KA fc <i/2} n kX n - We study separately all terms of this decomposition. 

• Because of Theorem 13.41 part 1- 1 as in the end of the proof of the large and 
principally semisimple case, Z n G o(n <T2 log" n) almost surely and in L p for every 
p > 1 (remember that TtkX n = Uk{X n )vk) ■ 

• Every J in the definition of Y n satisfies the assumption of the claim with a root's 
real part < 02 or a cardinality < v. Thus almost surely and in L p for every p > 1, 

Y n = o(n^ log" n) 

as n tends to infinity. 
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• For every k £ {2, . . . ,r}, Jk satisfies the assumption of the claim and if one 
denotes 

W U = lim Umia £}* n) , 

one obtains 



i_ n MJ k ) i og " nWfeiw + o K 2 log" n) 



almost surely and in L p for every p > 1, which completes the proof of (f2"3")l . Note 
that u min j fc is an eigenform of A and that 7 Tl ,n(A(Jfc))~ (X„) is an L- 1 - 

convergent complex-valued martingale. 

• Take any 0L2, ■ ■ ■ , oc r € Z>o. Then a = X^2<fc<r a k&mm J k is a semisimple power 
of large projections, and 



E ( n ^)=^^*w 

\2<fc<r y 



r(T1) %(A 1} 



r(n + (a,A» 



as can be deduced from Assertion 3- in Theorcm l3.4l This completes the proof of 
Theorem 13.61 ■ 



7 Remarks and examples 

7.1 Some remarks 

1- Average case study of a Polya process 

If {X n )n is a large Polya process, its asymptotic expectation can readily be 
deduced from Theorems 13.51 and 13.61 Without using the whole result, if (X n ) n 
is any Polya process, one can simply argue as follows. Thanks to Relation (fT5|) . 

i<k<s E u k(X n ).Vk- If J is any monogenic block of indices, the subspace 
Spanjufe, k € J} is $-stablc so that Proposition 1 5 . 1 1 ( which is elementary) applies. 
Hence Eu k {X n ) e 0(n SRAfc log" 5 " n) when A fc ^ 1 and Eu k (X n ) = nUk(X{)+0(l) 
when Af. = 1 (in order to directly apply Proposition l5.11 remember that Uf. = Qg k ) . 
These facts imply the following result, already given in [T] when 1 is simple root. 

Proposition 7.1 If Hi = X){fe A fc =i} denotes the projection on the eigensub- 
space ker(A — 1), then, as n goes off to infinity, 

E(X n ) =nU 1 (X 1 ) + 0(i2 T ) 

where r = max({5R(A), A <= Sp(A), A ^ 1} U {0}). 
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2- Drift when 1 is simple root 

When 1 is a simple root of a Polya process (X n ) n , the normalisation X n /n 
converges almost surely and in L- 1 to the non random vector v±. This can be 
deduced from Theorem 13.41 and Decomposition (|49|) . by arguments like in the end 
of Theorem 13. 51 s proof. This result is valid for small and large processes, without 
any irrcducibility-type condition (compare with [14jV 

3- Small Polya processes 

As it has been told in Section[TJ a small irreducible Polya process has a Gaussian 
limit after normalisation (for a precise meaning of the present notion of irreducibil- 
ity and complete results, see [1] and [2]). When the irreducibility assumption is 
released, this normality fails down. This fact can be explained by our treatment. 
We illustrate it in details in dimension 2. 

Take the general two-dimensional Polya process and choose coordinates such 
that the forms Ik are the coordinates forms in R 2 . The matrix of the replacement 

endomorphism A have then the form [ a , | where a and b are non- 

y a 1 — b J 

negative reals (with restrictive conditions ([3]) if at least one of them is > 1). The 
process is small whenever a + b > 1/2 because oi = 1 — a — b. Let's assume for 
our example that a + b > 1/2. If one makes the choice u 2 = ax — by, computation 
of the first reduced polynomials shows that 

2 abll — a — b) 2 

u-2 = Q(Q.2) - (a - b 1 -a- b)u 2 + — — — — Ul . 56 

v ' 2(a + 0) — 1 

The term of Eu\(X n ) having the highest order of magnitude is Eui(X n ) = 
nui(Xi), but its coefficient is zero if a or b vanish or if a + b = 1. Such con- 
siderations justify the fact that the study of small triangular urns, that are not 
irreducible, has to be done separately in terms of asymptotics and limit laws (see 

EH, M, ED]). 

In arbitrary dimension s, one can refine the error term in Assertion 1- of 
Theorem 13.41 but this refinement requires more careful use of the replacement 
endomorphism. This fact comes from the expansion Eu a (X n ) = EQ a (X n ) + 
J2/3< a a a,pEQj3(X n ): if a is a power of small projections, the term in the equality's 
second member having the highest order of magnitude as n goes off to infinity is 
not necessarily EQ a (X n ) 1 but EQ a (X n ) may nevertheless be the winner if suitable 
coefficients q a ,p vanish. 

4- Limit random variables Wk 

As it can be seen in the proof of Theorem 13.51 for any k <S {2, . . . , r}, the 
random variable Wk is defined as the limit of the process Uk(X n )/n Xk as n tends 
to infinity. This convergence is almost sure and in any L p , p > 1 and is proved by 
martingale techniques. 
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To know whether Wk is zero or not, it is sufficient to check the nullity of 
EWl = T(Ti)Q 2 s k (Xi)/r(n + 2Afc) when Wk is real-valued (that is when A fe is 
real), or of E\W k \ 2 = r(Ti)Q Sk +6 k , {X^/T^ + 25RA fc ) when W k is not real-valued 
(i.e. when A& G C\R), where k' is such that Uk = Uk> (conditionally to the choice 
of a suitable Jordan basis). 

Questions: what can be said about these variables? Are the laws of the Wk 
always determined by their moments? Can they always be described in terms of 
known densities or other distributions? 

All these remarks and questions can readily be adapted to limit variables Wk 
of Theorem 13.61 

5- Conjugate replacement endomorphisms 

In the asymptotic almost sure expansions (|22|) or (|23|) . a 2 , the complex num- 
bers Xk and A(Jfc) and the integer v depend only on the conjugacy class of the 
replacement endomorphism A. On the contrary, the distributions of the random 
variables Wk depend on the increment vectors Wk and on the linear forms Ik (and 
on initial condition X\), but not only on the conjugacy class of A = ^ fc Ik <8> Wk- 
two processes having conjugate replacement endomorphisms have the same asymp- 
totic form 123\) . but have in general different limit laws Wk- For example, the two 



as (conjugate) replacement matrices have respective second reduced polynomials 



Q(o,2) = M u 2 + H/20) (see (58])) and Q' (0 2) = u' 2 2 - -^u' 2 + (see (|56), 



evident notations). The algebraic relations satisfied by the moments of W and W' 
are not of the same kind. 

Another way to formulate this remark, as suggested by the referee, is the fol- 
lowing. Two processes may have the same replacement endomorphism A (which 
is the restriction of <i> over linear forms) without having the same transition op- 
erator $: this will imply in general different Q a 's, even though the asymptotic 
form will be of the same nature. Note however that having the same replacement 
endomorphism A does not mean having the same linear forms Ik and increment 
vectors Wk- 

A natural question arises: when two processes have conjugate (or equal) re- 
placement endomorphisms, are their limit laws connected by some functional re- 
lation? 

7.2 Examples 

1- Polya-Eggenberger urns 

As stated in Section [H any Polya-Eggenberger urn is a Polya process after stan- 
dardization, i.e. after division by S in order to get balance equal to 1. For further 
developments of examples on the general two dimensional urn process, on some 
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generic examples in dimension 5 and on the so-called s-dimensional cyclic urn 
whose (semisimple) replacement matrix is 



fO 1 

1 


V i 



1 

0/ 



see [19] (the cyclic urn defines a small Polya process if and only if s < 6 because 
(72 = cos(27r/s)). In the present article, see (|57p for some developments on the 
general triangular urn with two colours; other considerations are made on the same 
subject in [2D] . 

2- Triangular urns with two types of balls. 

The general two-dimensional balanced triangular Polya urn (generalized to real 
numbers) has the following R as replacement matrix: 



R 



1 

1-i £ 



(57) 



where £ is any real number < 1. In terms of Polya process, this means that 
and I2 are the coordinate forms, w\ = '(1,0) and W2 = '(1 — £,£)■ If one chooses 
U2{x,y) = y as second form for a Jordan basis, a straightforward computation 
shows that for any integer p > 0, one has Q p s 2 = U2(u2 + £)... {u 2 + (p — 1)£) 
and <fr(Q p 6 2 ) = p(QpS 2 (the simple computation of the image by $ of the product 
U2 (w-2 + £)■■■ suffices to show that this product equals Q p s 2 ) ■ Reversing this last 
formula leads, for any integer p > 0, to 



k=l ' 



!kS 2 



(58) 



where i^l denote Stirling numbers of the second kind (see for example |12j for 

this reversion formula) . 

In particular, if I > 0, since the order of magnitude of EQ p s 2 (X n ) is n p (Propo- 
sition EU), Eu 2 (X n /n e )P tends to £ p x T(xi + yi)/T(xi + yi + pi) x V{yi/£ + 
p)/T(yi/£) as n tends to infinity, where X\ = t (xi,yi) is the initial composi- 
tion of the urn. This shows the convergence in distribution of (X n — nvi ) /n = 
U2(X n /n e )v2 to the law having the written above expression as p-th moment (the 
asymptotics of the computed p-th moment as p tends to infinity shows by means of 
Stirling formula that the limit law is determined by its moments, proving the con- 
vergence in law; see for example [3] for relations between convergence of moments 
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and convergence in distribution) . For descriptions of this limit laws in some very 
particular cases of parameters X\ and I in terms of stable laws or Mittag-Leffler 
distribution, one can refer to [5D] or [IB]. When t > 1/2, the process is large so 
that this convergence is almost sure and in any L p , p > 1. 

The case t = is degenerate: the process is deterministic. 

When t < 0, as EQ p s 2 (X n ) £ 0(n pi ) (in any case, even if T\+p£ is a nonpositivc 
integer), Formula (|58[) implies that Eu2{X n ) p = 0(n e ) for any p. In this case, 
U2{X n ) tends almost surely to zero because balls of the second type can never be 
added (see for example [HI], Section 2, Degenerate cases). 

One can compare this to the results of [5D] and [TBJ . It can easily be generalized 
to some classes of triangular urns of higher dimension, principally scmisimple or 
not (with enough zero entries, see [19] for examples). 

3- Example of random replacement matrices 

The following example of urn process comes from a private communication of 
Bernard Ycart. Take an urn containing first b black balls, w white balls and one 
red ball. As in the case of Polya urn processes, one draws successively balls from 
the urn, with the following replacement rule. If a black (respectively white) ball is 
drawn, replace it in the urn together with another black (resp. white) one. If the 
red ball is drawn, replace it in the urn together with a black one with probability 
p £ [0, 1] or a white one with probability 1 — p. 

As it is described, this urn process is not Polya. But it is equivalent to the 
Polya process defined in M 4 by: the If. are the coordinate forms, the replacement 
matrix (i.e. the matrix whose rows are the coordinates of the Wk) is 



R = 











M 





1 








1 











V o 


1 





o / 



and the initial vector is (b,w,p, 1 — p). It can be viewed as "non- integer" four- 
colour Polya-Eggcnbcrger urn process, the colours being black, white, dark red 
and light red, the replacement matrix being R. Only the non-intcger initial vector 
prevents our first problem from being a true Polya-Eggenberger urn process. The 
matrix R admits 1 as double root, so that X n /n converges almost surely and its 
limit has Dirichlct distribution (see example 7-). 

This example can easily be generalised to other replacement rules, provided 
that one never adds any red ball. 

4- m-ary search trees 

"m-ary search trees are fundamental data structures in computer science used 
in searching and sorting " (citation from [5] ) . The space- requirements vector of an 
m-ary search tree under the random permutation model is an m — 1-dimcnsional 
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Polya process as can be seen in [J]. It only appears under the form of an urn 
process after some suitable change of coordinates. The associated endomorphism 
A is scmisimple and the process is large if, and only if m > 27. One can find 
further developments on this large process in [TH] . See [5] , [H| and [5j for different 
treatments of the subject. 

5- Random 2 3-trees 

This example comes from data structures in computer science too. The repar- 
tition of external nodes of a random 2 — 3-tree having 1 or 2 sisters is the two- 
dimensional Polya-Eggenberger urn process with initial condition X\ = (2, 0) and 
( -2 3 \ 

replacement matrix I ^ 3 ) ' ^his P roccss is small (<72 = — 6) and principally 

scmisimple. It follows from |14j that its second order term has normal distribution. 
This example is the base example of [5]. 

If one goes one step further, one can distinguish external nodes of a random 
2 — 3 tree with regard to the shape of the descendants-tree of their grand-mothers. 
This process is a 10-dimensional urn process with balance 1. Its replacement 
matrix 



R = 



1 


-4 


2 


3 




























-2 


-3 


6 

























-2 


-3 





6 




























-6 





4 



























-6 


4 


3 




























-4 


-3 


2 


6 







8 














-4 


-3 


































-2 


-6 







4 


2 


3 














-2 


-6 





\ 


4 








6 

















-9 



contains negative off-diagonal entries. This does not prevent the urn to be tenable 
(for "physical" reasons, as first argument!). Indeed, the columns of R containing 
these negative entries are coupled in the following sense: if j ^ k and rj,k < 0, 
then the columns of r^k and rkj are proportional. These proportionalities imply 
deterministic relations between number of balls of concerned colours. For example, 
at any time, the number of (algebraically) added balls of colour 9 is thrice the 
number of added balls of colour 8 so that when a ball of colour 8 is drawn, if one 
can subtract 2 balls of colour 8, one can subtract 6 balls of colour 9 as well. The 
same kind of property holds for balls of colours 2 and 3, and for balls of colours 
6 and 7. For such reasons, the same recurrence that shows that a Polya process 
does not extinguish shows that our urn is tenable. 

Moreover, our treatment of Polya processes readily applies to this urn process. 
It is small and principally scmisimple, with <T2 = (the multiplicity of the eigen- 
value of R is 3). Its study shows for instance that, if n is the number of external 
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nodes of the tree, the average number of their grand-mothers is ~ 0.182n, that 
on average ~ 21% (resp. ~ 24%) of external nodes have grand-mothers having 
themselves 4 (resp. 5) grand-children etc. 

Patient readers can go still one step further, looking at the fourth level of 
genealogical trees of external nodes. This leads to the study of a 76-dimcnsional 
urn process. 

6- Congruence in binary search trees 

The following example is mentioned in [B] as a private unpublished idea of S. 
Jansor0. Take a binary search tree and an integer s > 2. Consider the random 
vector of W whose fc-th coordinate is the number of leaves whose depth is = 
k [mod s]. This defines an s-colour urn process with (semisimple) replacement 
matrix 

/ -1 2 \ 

-1 2 
-1 

• 

'■■ 2 

V 2 -1 J 

the balance is one and a 2 = — 1 + 2cos(27r/s), so that the urn is small if and only 
if s < 8. As it is readily irreducible, it can be deduced from [T3] that its second 
order term has normal distribution when s < 8. When s > 9, the process is large 
and its asymptotics is described by Theorem 13.51 

7- Processes having 1 as multiple root 

Let (X n ) n be a Polya process having 1 as multiple root; the way to use Theo- 
rem [375] to determine the almost sure limit law of X n /n suggests to abandon our 
convention u\ = 53*=i ^- This does not change the validity of the whole result. 

Let r > 2 be the multiplicity of 1 as eigenvalue of A. We choose a basis 
(u\, . . . , u r ) of A-fixed linear forms (i.e. a basis of ker(*j4 — 1)), using the classical 
following construction. Consider the graph Q whose vertices are the numbers 
{1, . . . , s} and where two vertices i and j are connected by an edge when h(wj) ^ 
or lj(wi) ^ 0. Let ii, . . . , I r be the connected components of Q (the fact that there 
are r such components in a consequence of what follows). For any (j, fc), it is readily 
shown that lj(wk) = if j If.- We define 

Uk = Yl l i 

3 eik 

for any fe G {1, . . . ,r}, so that u k {wj) = if j g h and u k (wj) = J2i<i< s l i( w j) = 
1 if j G Ik ■ A straightforward computation shows that any Uk is an j4-fixed linear 
form. Moreover, the restriction of l A to the stable subspace spanned by the lj, 

7 S. Janson has developed his example in |15j during the revision of the present article. 
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j e Ik is irreducible so that, because of Perron- Frobenius theory, Uk spans the 
unique line of A-fixed forms of this subspace. This shows that (iti, . . . ,u r ) is a 
basis of A-fixed linear forms. This basis is then completed into a Jordan basis 
(ux, ... ,u s ) under conditions 2- of Definition 12.31 

For such a basis, J^fe=i ^ = 2fc=i The properties of w^'s imply in partic- 
ular that for any a = (a%, . . . , a r , 0, . . .), 

r 

^ = n ,ife ( ufe + i ) • • ■ ( Ufe + ^ _ !) 
*;=i 

and that Q a is eigenfunction for <!>, associated with the eigenvalue \a\ = X)fe=i a fc- 
It follows then from Theorem 13.51 that X n /n converges almost surely and in any 
L p , p > 1 to a random vector X)I-=i WkVk, where the joint moments of the real 
random variables Wi , . . . , W r are given by 

fw<*= T{Tl) n r K(^i) + ^) 

r(r 1 + H)ll r(u k (x 1 )) ■ 

One recognizes here the moments of a Dirichlet distribution with parameters 
Ui(Xi), . . . , u r (Xi) whose density on the simplex {x\ > 0, . . . , x r > 0, 5Zfe=i ^fc = 
1} of W is given by 

( * ^"Hg-'Hs™) 

(see This distribution is obviously characterized by its moments. In reference 

to the original paper of Polya, processes under this assumption have been called 
essentially Polya in |19j , 
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